Is dynamic ultrametricity observable in spin glasses? 
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We investigate the dynamics of spin glasses from the 'rheological' point of view, in which 
aging is suppressed by the action of small, non-conservative forces. The different features can 
be expressed in terms of the scaling of relaxation times with the magnitude of the driving 
force, which plays the role of the critical parameter. Stated in these terms, ultrametricity loses 
much of its mystery and can be checked rather easily. This approach also seems a natural 
starting point to investigate what would be the real-space structures underlying the hierarchy 
of time scales. We study in detail the appearance of this many-scale behavior in a mean-field 
model, in which dynamic ultrametricity is clearly present. A similar analysis is performed 
on numerical results obtained for a 3D spin glass: In that case, our results are compatible 
with either that dynamic ultrametricity is absent or that it develops so slowly that even in 
experimental time-windows it is still hardly observable. 
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I. INTRODUCTION 

A remarkable feature of mean-field models of spin glasses is the fact that pure states are organized in a 
hierarchical way. Given three equilibrium configurations (1,2,3) they determine a triangle whose sides are 
measured by the overlaps q±2, qi3 and 523 • If the configurations are chosen with the Gibbs weight then the two 
smallest overlaps are equal: all triangles are isosceles. This property, valid in the thermodynamic limit, defines 
an ultrametric space 

A first question to ask is whether ultrametricity exists in finite dimensional systems. Numerically, this is 
investigated by searching low temperature ground states of very small systems, and looking for an ultrametric 
organization between them [Q . Experimentally, however, spin glasses are always out of equilibrium, and another 
relevant question may be to know what signatures of ultrametricity can be observable in a non-equilibrium sys- 
tem in the thermodynamic limit. In a relaxing (aging) mean-field system, it has been shown that ultrametricity 
would manifest itself in the dynamical behavior j5|||: the correlation functions at three times t\ > t% > ts ^> 1, 
C{t\,t2), C{t2,tz) and C{t\,t$) satisfy the relation 

C(h,t 3 ) = mm{C(t u t 2 ) , C(t 2 ,t 3 )}. (1) 

This property is often termed 'dynamic ultrametricity'. A link between dynamic and static ultrametricity 
has been established by Franz et al |)|, who showed that the existence of an ultrametric solution from the 
dynamic point of view implies, under certain assumptions, the hierarchical organization of pure states in short- 
range systems. However, we are not aware of any report of dynamical ultrametricity (in the form (|l])) in a 
simulated finite dimensional system, or in experiments |§|]l0[] . The reason may be that dynamic ultrametricity 
such as described by (|l|) is extremely difficult to observe numerically in an aging system [^lj. Hence, for 
the 3D Edwards- Anderson model, Franz and Ricci-Tersenghi [ p"2[ resorted to an indirect argument involving 
the coupling of replicas. Their simulation (together with their argument) then suggests a situation for three 
dimensions similar to the one observed in mean-field models. 

From the experimental point of view, one obviously cannot use the method of [12]. Moreover, noise autocor- 
relations are extremely difficult to measure, but one can check the version of Eq. (|l|) involving the response 
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where M TRM (t a )\ ta=tb is the thermoremanent magnetization at time t a when the field was cut off at time £&. 
Such a relation is not observed experimentally. Indeed, the fit 
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works very well for suitable functions h(t) and it is incompatible with dynamic ultrametricity. 

As has been often remarked, glassy dynamics can be studied in two complementary forms. One can study 
the relaxational aging system — and then the large parameter is the waiting time t w — or one can drive the 
system in such a way it becomes stationary [|l 3| — |l 5f| - In this second 'rheological' form, the relevant parameter 
is the intensity of the driving force. Superconducting vortex systems with disorder have been studied this way 
in the presence of current the vortices are driven by a Lorentz force. In a spin glass, though less obvious 
to implement in experiments, the role of a 'stirring' force can be played by non-symmetric couplings [T^2C|]. 

Consider a system to which some non-conservative force of strength e is added. It is by now well established 
that in a quench experiment, after some transient, the system becomes stationary. If the system is glassy, the 
relaxation times in the stationary regime will diverge as e — > 0. (The time necessary to achieve stationarity 
is of the same order, and will diverge as well — we will not study this in the paper.) Indeed, we have that 
correlations decay for small e as C(t) — Cf(t) + C s (t, e), where the subindices denote 'fast' and 'slow'. [Recall 
that since we are in a stationary state, all the functions depend on a single time argument.] Cf(t) represents 
the 'cage' motion, or the fluctuations inside a domain, and is not affected by a small perturbation. C s (t, s) is 
the slow motion, in which the system moves along the 'almost flat' directions that are responsible for aging (e.g. 
structural rearrangements in a glass, domain wall motions in coarsening). The Edwards- Anderson parameter is 
given by q = limt^oo lim £ ^o C(t). A similar decomposition holds for M^- R (t). 

The dynamic ultrametricity discussed above becomes extremely simple in terms of the scaling of C s (t,e) as 
e — > 0. One possibility is indeed simple scaling: 
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where t(e) — * oo when e — > 0, and / is a scaling function. Whenever Eq. (Q) holds, we have that for two values 
of the correlation C\ < C 2 < q: 



t(C 2 



constant, 
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where the relation C s (t) has been inverted to give t(C). The behavior of Eqs. (f||f]) is not the only possibility. 
An alternative would be that C s (t) is the sum of several terms of the type (^), each having a different scaling 
with e. An extreme example of this is the ultrametric law, which for all C\ < C'2 < q results in 
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The relationship of this property to Eq. (|l|) is immediate since, in the limit e — > 0, one has C(t(C%) + t(C 2 )) ~ 
C(t(C\)) — min{C(£(Ci)), C(t(C 2 )}, which is the application of Eq. (|l|) to a stationary situation. This point 
is discussed in more detail in section [II C| . The two following examples illustrate our discussion. Simple scaling 
is, for small e: 



t 
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where j(C) is the inverse function of /, while dynamic ultrametricity may be obtained with the small e scaling 

(8) 



ln[i(C)]~F(e)i(C) & CS)~f(j^, 
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where t(e) may diverge with e — > as, for example, i(e) ~ e~ a and j(C) is a positive decreasing function of C. 
Equation (|^) clearly implies @ and (Q), and expresses the hierarchical scaling in a very straightforward way. 
In the stationary case, dynamic ultrametricity simply differs from simple scaling in that to make the correlation 
curves for different small e collapse, one has to rescale ln(f ) instead of t with a function of e. 

Let us emphasize that such a simple statement of ultrametricity is not possible in the aging case. Consider, 
as an example, an aging system with correlations evolving as C(r + t w , t w ) = hx(t w )/ l&(t w + t), which is non- 
ultrametric since C{t^,t\) = C(t^,t2) * C(t2,t±) (as opposed to Eq. (|l|)). If we compare the time-differences 
t(C) to reach two correlation values C\ < C2, it is easy to find: 

Ip) ~{t w )ik-A _ oo. (9) 

Hence, a criterion like (^|) with t w playing the role of the large parameter is not applicable in the aging case, 
and one has to go back to Eq. ([!]). 

Our aims in this paper are the following: 

(i) Within mean-field, the solution exhibiting dynamical ultrametricity relies on an asymptotic analysis of the 
dynamical equations involving two-point correlation and response functions, which may thus be questionable. 
We will show that this analysis is indeed correct by solving numerically the dynamical equations governing the 
driven dynamics of a mean-field spin glass in the stationary regime. This is done on a very wide range of time 
scales, making us confident that the asymptotic solution is the correct one. 

(ii) Since ultrametricity should hold strictly in the asymptotic limit of zero driving force (or equivalently in 
the infinite waiting time limit in the aging case), it is important to study also the preasymptotic regime to 
understand how ultrametricity gradually develops, and how a full hierarchy of time scales appears. We analyze 
then this preasymptotic regime in detail, thus characterizing the onset of ultrametricity. 

(iii) Having the mean-field dynamical behavior in mind, it is very tempting to see if something similar happens 
in a finite dimensional system. We have then performed a Monte-Carlo simulation of the 3D Edwards- Anderson 
model with asymmetrical couplings. As is (unfortunately) usual in 3D spin glass simulations, our numerical 
results may be interpreted in two different ways. They are indeed compatible with an extremely slow appearance 
of dynamic ultrametricity, i.e. much slower than in the mean-field case. But an alternative view is that there 
is asymptotically only one relevant time scale, or, in other words, that dynamic ultrametricity is not present 
at all. In both cases the conclusion is that even if one assumes that ultrametricity is present, it has not fully 
developed for experimentally accessible time windows. 

The paper is organized as follows. In the next section, the mean-field model under study is presented, and its 
preasymptotic behavior is detailed in Section III . Section [w| presents our numerical results in three dimensions 
and Section V contains our conclusions. 



II. A MEAN-FIELD DRIVEN SPIN GLASS 



A. Model 



We focus in the paper in a mean-field spin glass model first introduced in Ref. |21|, where the statics was 
solved. The equilibrium dynamics was recently worked out p2| . It consists in a slight modification of the 
spherical p-spin model. We consider indeed N continuous variables Sj (i = 1, ■ • • , N) interacting through the 
Hamiltonian 

00 

H = -J2 j h-3v s h--- s i P - ( io ) 

P=2 jl<---<j P 

In this expression, the J's are random Gaussian variables, symmetrical about the permutation of ■ ■ ■ ,j p ) 
with mean zero and variance 
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so that the thermodynamic limit is well-defined. A spherical constraint X^=i s 2 (t) = N is moreover imposed 
to the spins. It is convenient to define also the function 

-j oo 

g(C)^-J2J P 2 c p - (12) 

p=2 

The interesting case is when quadratic couplings are present together with quartic and/or higher order interac- 
tions. It was shown that the model belongs then to the universality class of the Sherrington-Kirkpatrick model 
pl| , p2| : it has a continuous transition between a paramagnetic phase and a spin glass phase characterized by a 
full replica symmetry pattern and a non-trivial probability distribution of overlaps P(q). Quantitatively, below 
the transition, one has 

<C <<l)=£ d<W) = T ^fMsT 2 i x(C>q) = l, (13) 

where q is the Edwards-Anderson parameter. This holds only if Ji is big enough so that x'(C) — P(C) > 0. 
We consider in the following the combination of second and sixth order terms, keeping then only J2 and Jq 
different from zero. In this particular case, one has T c = J2 (independent of J§). The positivity of x'(C) gives 
moreover the inequality Jq 2 < J2 2 /15. 



B. Driven dynamics 

To study the driven dynamics of the model, it is usual to consider a Langevin equation 

^--Mtfcw-dlj+.r (<)+*(«>. <») 

As discussed in the introduction, we take for the (non-conservative) driving force 

/,"' E Jt^- 1 ^---^. (15) 

ji<---<jk-i 

The parameter e controls the strength of the force. The couplings J's in the driving force are random Gaussian 
variables, symmetrical about the permutations of (ji, • • • , jk-i), with mean zero and variance 
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These couplings are partially uncorrelated and contain thus an antisymmetrical part. This makes it impossible 
to write the driving force as the derivative of an energy. The parameter /i(t) ensures the spherical constraint and 
r]i(t) (i = 1, • • • , N) are random Gaussian variables with mean and variance 2T, where T is the temperature 
of the heat bath. 

The dynamics of the model is better analyzed in terms of the autocorrelation function C{t, t') = 
Yli( s i(t) 8 i(t')) /N and the response function R(t,t') = ~^2i{$Si(t) / 8r]i(t')) /N , since in the thermodynamic limit, 
N — > 00, C(t, t') and R(t, t') verify closed Dyson equations ||. The presence of the non-conservative force allows 
to replace two-time functions C(t,t') by single arguments functions C(t — t'), and the following equations are 
obtained: 

= - //C(t) + / dt'E(t - t')C(t') + [°° dt' [S(i + t')C{t') + D(t + t')R(t')} , 
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These integro-diffcrcntial equations are associated with initial conditions C(0) = 1, R(0 + ) = 1 and with the 
condition R(t < 0) = (causality). The use of C(—t) = C(t) in the derivation of Eqs. ( |17| ) made these equations 
non-causal in the time difference, as can be seen from the last integral in the equation for C(t). 



C. Asymptotic solution of the dynamical equations 

In order to make the paper self-contained, and to set our notations, the asymptotic analysis of Eqs. ( |l7| ) is 
now briefly recalled. A more detailed computation can be found in g. 'Asymptotic analysis' means that the 
limit e —> is taken. 

The first step of the analysis consists in making the decomposition C(t) = C s (t) + Cf(t) and R(t) — R s (t) + 
Rf(t) between a fast and a slow part, and to derive the equations verified by each part. The equations 
for Cf and Rf are solved by making the ansatz that they satisfy the fluctuation-dissipation theorem (FDT) 
TRf(t) — —dCf(t)/dt. Taking the limit t — > oo gives then the following relation: 

g'(q)-g'(l) _ T 
M+ f , (18) 

where q = limt^oo lim £ ^o C(t) is the Edwards- Anderson parameter. The slow parts verify: 



dC s (t) 
dt 



= - nC s (t) + J d*'E s (i - t')C s (t r ) + I dt' [S s (t + t')C s {t') + D s (t + t')R s (t')} 



^ = - Mt) + [ M'Mt - t>)R s (t>) + 9 -^/^R s (t) + ^Mt), (19) 

/i =T + r dt' [D s {t')R s {t') + E a (t')C s (t')] + g/(1) ~ gg ' (g) , 
Jo 1 

D s {t) =g'(C s (t)), E,(t) ee g"(C s (t))R s (t). 

The second step stems from the observation that once the first order derivatives are dropped out (which is 
of course justified in the slow regime), the above equations become invariant under a reparametrization of time 
t — > hit). This suggests that C s and R s are related through a reparametrization- invariant formula, namely 

B . (t) = (20 , 

This amounts to an extension of the FDT to this non-equilibrium situation [JL4] by the introduction of an 
effective temperature T c g(C) = T/X(C). In the same spirit, the function / defining 'triangles' is introduced: 

C.(ti+t 2 ) = /(C.(ti),C 5 (t2)), (21) 

Let us emphasize that the main assumption of the analysis is that the functions X(C Sl e) and /(Ci, C2, s) have 
a continuous limit when e — ► 0. It is also convenient to define the function /: C s (ti) = f{C s (t2), C s (ti + £2))- 
This allows to rewrite Eqs. (119) in such a way that the time disappears: 



= - ^- q C s + ^-g'iC s ) + i £ dC' s g"(C' s )X{C' s )f(C' sl C s ) 

i [ C "dC' s XiC' s )g"(C' s )fiC s ,C' s )-^ I""* dC' s g"iC' s )F[fiC s ,C>)} 
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(22) 
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where Eq. ( |l8| ) has been used. 

The last step consists in computing explicitly X and / from Eqs. (p2j). This is done by introducing 'fixed 
points' of / ||. A fixed point q* of / satisfies 

f(q\q*)=q*. (23) 

In the stationary context we are discussing, the physical meaning of such values of the correlation is very clear, 
since from the definition of /, 

q* = C s (t) C s (2t) = f(C s (t), C s (t)) = C s (t), (24) 

which simply means that q* is a plateau in the correlation function. Two trivial such fixed points are q — and 
q = 1. It is then rather straightforward || to solve Eqs. (|22]). This gives X(C) for C E [0, q], 

x ^ = T uf$^- (25) 



and the matching with the FDT regime {X{C > q) = 1) determines q which satisfies T = (1 — q)^Jg"(q). The 
fact that X{C) coincides with x(C) (Eq. (|l3|)) is a remarkable property of this class of mean-field spin glass 
models 0J^]. The properties of / are also obtained. It is first shown that VC 6 [0,g], f(C,C) = C, and there 
is hence a continuum of fixed points. Crudely speaking, it can be said that, in the asymptotic limit, each value 
of C < q corresponds to a plateau value in the correlation function (in the sense that the correlation will not 
decay below this value in a finite time). This ultimately means that we will have a behavior as described by 
Eq. (@). It is also shown that 

V(C 1 ,C 2 )e[0,l] 2 \[ g ,l] 2 /(C 1) C 2 ) = min{C 1) C 2 } ) (26) 

which is the ultrametric relation, as presented in the introduction. 

The conclusion of this section, is that, apart from the trivial short time behavior where C(t) > q and FDT 
holds X(C > q) — 1, the relaxation below q is characterized by a hierarchy of time scales and a non-trivial FDT 
X(C <q)<l. 



III. ULTRAMETRICITY FROM DYNAMICAL CORRELATIONS 



As stated in the preceding section, the asymptotic solution of the dynamical equations exhibits a 'many- 
plateau pattern', which is an unusual feature. To see how this asymptotic solution is approached, Eqs. (O) 
were solved numerically, in the particular case where g(C) — C 2 /2 + C 6 /30, and k = 2. We shall mainly 
work at T = 0.25 = 0.25T C , where the Edwards- Anderson parameter is q ~ 0.787. To solve these equations, a 
combination of numerical methods of Refs. p||,|3| has been used. 



A. Hierarchy of time scales 



A first element that is missed by the above analysis is the functional form of the correlation functions. They 
are depicted in Fig. [I], for different values of e and for T = 0.25. As expected, two different regimes are clearly 
present. For C(t) > q, the relaxation depends very weakly on the asymmetry, while for C(t) < q, the smaller 
the asymmetry, the slower the relaxation. 

The main question that cannot be answered analytically is the precise dependence of the relaxation times 
on the parameter e that controls the strength of the asymmetry. The 'many-plateau pattern' discussed above 
means that, in the preasymptotic regime (non-zero e), the correlation will stay a large, albeit finite time around 
the same value. This characteristic time increases with decreasing C, as expressed by Eq. (^). In order to test 
this separation of time scales, we compute the ratio of relaxation times for two fixed values C\ and C2 of the 
correlation as a function of e. Two such ratios are represented in Fig. ||, where it is clearly seen that they 
indeed diverge in the small asymmetry limit. A consequence is that the relaxation cannot be represented by a 
single time scale, but involves a full hierarchy of them. In particular, a stretched exponential fit such as the one 
proposed in p9| for the Sherrington-Kirkpatrick model with asymmetry can only be approximate. 



(i 



The numerical solution of the dynamical equations suggests the following dependence for C < q: 



t(C) ~ exp t(e)j(C) ■ t(e) 



.-0.65 



(27) 



In this expression, j(C) is a positive decreasing function of the correlation. It plays the same role as in the 
example of the introduction, Eq. (||). Numerically, j(C) is consistent with a linear variation: j(C) — j(C = 
0) — bC. For a fixed value C of the correlation, t{C) grows faster than a power law of e, as was noted in Ref. 
Ittl . It also follows that 



t{C 2 



exp 



i(Ci)-j(C 2 ) We) 



(28) 



which means that the ratios of two time scales may be fitted by the same functional form ( |27| ) as the time scales 
themselves. This is also displayed in Fig. ^. 

Let us note that the scaling (|27]) is very reminiscent of the 'creep' regime scaling for vortex glasses jF6|, with 
the role of e played by the current and C a measure of the average squared transverse displacements along the 
vortex. 

The presence of this hierarchy of time scales i n (|27| ) implies that the correlation curves can not be superimposed 
by rescaling the time. This is illustrated in Fig. |3|, where the time is rescaled so that the curves meet at the value 
C = 0.3. It can be seen that the curves are more and more horizontal around C — 0.3, when the asymmetry is 
decreased. On the contrary, if we rescale the logarithm of the time to make the curves meet at C = 0.3 (Fig. ^) 
we find that the curves tend to collapse. In other words: shifting ln(i) (as in simple scaling) does not make the 
curves collapse, while stretching ln(t) does. A similar picture would have been obtained by choosing any value 
CG[0,q\. 

This rescaling (or absence thereof) of the correlation functions in the driven dynamics of a spin glass is a 
direct and very simple test of dynamic ultrametricity. Let us emphasize again that, as already mentioned in 
the introduction, this is not true for the aging regime. 




FIG. 1. Correlation function as a function of time for different values of the asymmetry for the mean-field model, 
at T = 0.25. From left to right, e = 2.25, 0.8, 0.5, 0.35, 0.248. The horizontal dashed line is the value of the 
Edwards- Anderson parameter q ~ 0.787. 
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FIG. 2. Two different ratios of relaxation times as a function of the asymmetry for the mean-field model. Note that 
the vertical axis is in a logarithmic scale. Also plotted is the divergence of i(0.5). The lines are fits of the form 
with j[C) as a fitting parameter. 




FIG. 3. Correlation function for the same values of the asymmetry as in Fig. [jj. The time is rescaled by t(0.3) so 
that curves superpose for C = 0.3. Away from this value, there is no collapse for small e. 
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FIG. 4. Correlation function for the same values of the asymmetry as in Fig. pi but here the logarithm, of time is 
rescaled by ln[i(0.3)]. The collapse for small e is good. 



B. Ultrametric relation and FDT 

The function f(C\, C2) introduced in Eq. ( |2l| ) satisfies in the asymptotic limit the ultrametric relation (pq). 
It is then natural to try to understand its preasymptotic behavior. A three dimensional view of this two- variable 
function is given in Fig. ||, for e = 0.248 (the slowest relaxation in Fig. |l|). Also plotted in the plane (Ci, C2) 
are the constant-/ contours. These contours would be right angles in the limit of vanishing asymmetry. 

To see how the function / evolves towards its asymptotic value (the ultrametric relation (|2q)), the evolution 
of the contours for different e is represented in Fig. ^. These curves are very clearly evolving towards right 
angles, as expected from the analysis of the preceding section. 

It is interesting to compare these curves with the ones obtained from Ref. Jl5| for a system (p-spin with p = 3) 
with a single time scale, i.e. without ultrametricity. The result is shown in Fig. [?], for correlations that evolve 
on a similar range of time scales to make the comparison relevant. In this case, the asymptotic analysis reveals 
that there exists asymptotically a function / defined as above, but it is not given by the ultrametric relation 
(p6|). The difference between the two systems is very clear from the comparison of Figs. || and]?]: in the latter, 
the function / rapidly saturates to its asymptotic (non-ultrametric) value. 

To make the analysis of the mean-field dynamics complete, the usual plot Q of the integrated response 
function X (t) = j* dt'R{t') as a function of the correlation function C(t), parameterized by the time t, is done 
in Fig. 0. As expected from the above analytical results, the FDT holds for C(t) > q and it is strongly violated 
for smaller values of the correlation. It is clear that in the limit of zero asymmetry, the analytic expression for 
the function X(C) that generalizes the FDT to non-equilibrium situations will be recovered. The fact that the 
same limiting FDT violations happen in gently driven and aging systems has been suggested in Ref. jL4j , and 
we have verified here that this (mean-field) result holds also for systems with many time scales. 
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Ci 

FIG. 6. Evolution of the projections for / = 0.1, 0.25, 0.4 and 0.6 (see text) in the plane (Ci, C2) for the values of the 
asymmetry as in Fig. |lj e = 2.25, 0.8, 0.5, 0.35 and 0.248. At each level /, the upper curve is for the larger asymmetry, 
and decreasing the asymmetry make the curves move towards right angles. 
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FIG. 7. Evolution of the projections for / = 0.05, 0.1, 0.2, 0.3 and 0.45 (see text) in the plane (Ci,C2) for the p-spin 
model (here p = 3) studied in Ref. [15]. At each level /, the upper curve is for the larger asymmetry. In this case, 
the Edwards- Anderson parameter is q ~ 0.501. The asymmetry (4 values are represented) is chosen so that correlation 
functions cover a range of time scales similar to that of Fig. |l| When the asymmetry is decreased, the function evolves 
rapidly towards its limiting (non-ultrametric) shape. 




FIG. 8. Parametric plot of the susceptibility vs the correlation functions for T = 0.25 and e = 0.8, 0.5, 0.35 and 0.248 
for the mean-field model. The dashed curve is the analytic result, Eq. (Eil), for the limit e — > 0. 



IV. SIMULATION OF THE 3D EDWARDS-ANDERSON MODEL 



We turn now to the numerical results obtained for a 3D spin glass model, the results of the preceding sections 
being a guide to investigate its stationary driven dynamics. We use the same notations for quantities that play 
a similar role in the simulation and in the mean-field model, the distinction between the two cases being clear 
from the context. 
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A. Model and details of the simulation 



The model under study is denned through its Hamiltonian 



H / JijSiS 

(id) 



(29) 



where Si (i = 1, . . . , N) are N — L 3 Ising spins located on the sites of 3D cubic lattice of linear size L, with 
periodic boundary conditions. The sum runs over nearest neighbors and the J's are chosen randomly from 
a bimodal distribution Jy = ±1. The model has been extensively studied Jl0|]: it exhibits a second order phase 
transition at the critical temperature T c = 1.11 ± 0.04 from a paramagnetic to a spin glass phase p5| . 

To drive the system, a coupling is added on each link. The J's are chosen from a bimodal distribution 
Jij = ±e, and are antisymmetrical: = —Jji- The small parameter e controls the strength of the driving 
force. The spins are randomly sequentially updated through a standard Metropolis algorithm, and one Monte 
Carlo step represents N attempts to update a spin. Numerical results are presented for a linear size L — 20 
(N = 8000 spins), where finite size effects are negligible for the time scales investigated here p6| . 

The temperature has been chosen so that the Edwards- Anderson parameter is comparable to the one of the 
mean-held case studied before. At T = 0.6 ~ 0.54T C , the Edwards- Anderson parameter was roughly estimated in 
an off-equilibrium simulation (with e — 0) through its dynamical definition q = lim^oc limt ra _»oo C{t,t w ) ~ 0.8 
(we had q ~ 0.787 in the mean-held study). Similarly, 5 different values of the asymmetry were studied: 
e = 0.5, 0.4, 0.3, 0.25 and 0.2, so that the range of time scales is comparable to the previous mean-field results. 
Remarkably, initial conditions are irrelevant, since a stationary state is reached after a time which depends 
on the intensity of the drive. As was already noted in Ref. |27[ , this is an unusual feature for glassy systems 
where cooling procedures are known to be crucial. Stationarity allows moreover to average the correlation 
functions over different initial times, so that very few averages over the disorder have been necessary (typically 
5), provided the first steps of the simulation are discarded. Stationarity has been carefully checked throughout 
the simulation. 



The dynamical quantity of interest is the spin-spin autocorrelation function, which in the TTI regime reads 



The overline means that an average over disorder is performed, while (• • • ) stands for an average over different 
initial times to, all chosen in the TTI regime. 

The autocorrelation functions for different values of the asymmetry at T = 0.6 are represented in Fig. |^. As 
for the mean-field case, two different regimes are present. The short time relaxation towards q ~ 0.8 is very 
weakly affected by the driving force, while the time to relax towards dramatically increases when e is lowered. 

The crucial point is to look for the possible presence of the ultrametric relaxation pattern described in the 
preceding sections. We have seen above that a simple test of the presence of ultrametricity is the rescaling of 
the time. The same rescaling that was done in Fig. ^| for the mean-field case is now performed for the 3D case in 
Fig. [l(]. Although not perfect, this rescaling works remarkably well for the smallest values of C. It is important 
to note that even if ultrametricity is absent, the values of correlation 1 < C < q (which do not depend on the 
asymmetry) will not scale together with the C < q portion of the curves. This may be a source of errors if the 
value of q is unknown. Thus, preasymptotic effects affect the quality of the rescaling in the region C ~ q, since 
it can be seen from Fig. [9] that the plateau is not completely developed. All these points may explain why the 
rescaling is good only for the smallest values of C. 

However, a very slow flattening of the curves around the value C = 0.3 cannot be completely excluded from 
this figure. But it is very clear that if there is a separation of time scales, then it will become evident only if a 
much larger time window is analyzed. 

The second interesting quantity to study is the function /(Ci, C2) introduced in Eq. (^l|). Its evolution for 
different values of the asymmetry is depicted in Fig. O, with the same construction as for Figs. @ and ffl. The 



B. Looking for ultrametricity 




(30) 



i=l 
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function / indeed evolves, but very slowly when compared to the mean-field case. The quantitative behavior of 
/ for the 3D model is more reminiscent of the p — 3 case than of the mean-field spin glass case. Once again, this 
figure does not allow to decide clearly between a limiting smooth - as it is for the p — 3 case - or ultrametric 
/-function, because interesting things may happen on time scales that are inaccessible in our simulation time. 

In our opinion, the important point that clearly emerges from the figures is that, on a given time window 
(we have 4 decades here), the relaxation does not appear to be typical of an ultrametric system and a single- 
time-scale description is very accurate. This may explain why dynamic ultrametricity has not been observed in 
aging experiments, which span some six decades ~ (100 Hz. - 10 hours). 




FIG. 9. Correlation functions for the 3D Edwards- Anderson model for different values of the asymmetry at T = 0.6. 




t/t(0.3) 

FIG. 10. Rescaling of the correlation functions of the Fig. ^[ The rescaled time is such that all the curves meet at the 
value C — 0.3. This figure has to be compared with Fig. \\. 
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FIG. 11. Test of the function / for the 3D Edwards- Anderson model for / = 0.6, 0.4, 0.25 and 0.15. The values of 
the asymmetry are the same as in Figs. [] and |lo[ and are represented with the same symbols. This curve has to be 
compared with Figs. ^ and Q 



C. FDT 



We have also investigated the way the FDT is violated in the driven 3D Edwards- Anderson model, since the 
mean-field theory suggests that these violations are the same as for an aging system. To our knowledge, there 
are no numerical confirmation of this prediction for spin glasses in the literature. For this purpose, correlation 
functions have to be compared to susceptibility curves. The correlation functions are taken from Fig. ^. The 
way of computing the susceptibility is now standard f28|| . A stationary magnetic field hi is applied in each 
site at time t . It is random in space, and we take it from a Gaussian distribution with mean and variance 
hihj = h,Q. The staggered magnetization 

1 N 

m(t) = hrN^ hiSi{t) > (31) 

i— 1 

is recorded for all t > to- In the linear response regime (we work with ho = 0.1, as in previous studies Jl0| , p8[ ), 
the susceptibility is obtained from m(t) as x(i) ~ m(t)/ho- The results are averaged over several (from 50 to 
300) realizations of the field, and over different initial times to- They are presented in Fig. [IJ. 

The results for the violations of the FDT are clearly very similar to the mean-field ones. These curves exhibit 
two different regimes: for short times (C > q), the FDT is well satisfied, whereas for longer times (C < q), 
it is violated. The curves also clearly saturate to a smooth limiting curve in the small asymmetry limit. The 
shape of this limiting curve is compatible with the limiting non-trivial parametric curves that have already 
been found in simulations of 3D spin glasses in the aging regime Q . The fact that both situations (aging and 
driven dynamics) exhibit the same kind of FDT violations deepens, in our opinion, the physical meaning of the 
quantity X(C) (the so-called fluctuation-dissipation ratio) that can be extracted from this plot P,[l4],p9| . 
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FIG. 12. Parametric plot of the susceptibility vs the correlation functions for the 3D model for different values of the 
asymmetry, at T = 0.6. The curves saturate, in the small asymmetry limit, to a smooth limiting curve. 



V. CONCLUSIONS 



We have studied in this paper the behavior of spin glasses in a 'rheological' setting, in which the dynamics is 
stationary and the control parameter is the strength of the driving force. 

We have checked the asymptotic analysis J^-Q] for mean-field models through the numerical integration of 
the equations governing the dynamics. This has confirmed the presence of a full hierarchy of time scales in the 
relaxation of the correlation, Eq. (26), and a 'many-time-scale, many-temperature scenario' Jig] , This scenario 
can be seen as the dynamic counterpart of static ultrametricity. Simple scaling time dependencies, such as 
assumed in Ref. fl9[| could be justified for mean field models only as an approximation valid in some time- 
window, but do not hold strictly in the large time limit. Previous numerical studies of the aging dynamics of 
the Sherrington-Kirkpatrick model had pointed out the lack of simple t/t w -sca\mg po| , but did not investigate 
the presence of ultrametricity. Since there exist now powerful algorithms to solve dynamical two-time equations 
for large times |3l) , it would be interesting to have an analysis of the aging dynamics of a mean- field ultrametric 
model following the lines introduced in this paper. 

For the 3D spin glass, our simulation suggests that the stationary driven dynamics is accurately interpreted 
within a single time scale relaxation pattern. We cannot decide whether our results imply an extremely slow 
appearance of ultrametricity (such that, even at experimental times, it is not fully observable), or its absence. 

Whether transient or permanent, the single time scale relaxation obtained in our 3D simulation is in complete 
accordance with all the known numerical and experimental studies of the aging regime of 3D spin glasses 
|fi ^0[[3^| . In all known cases, two-time functions are indeed very well approximated by M(t,t w ) ~ A4(t/t w ), in 
contradiction with the dynamical mean-field theory, as we emphasized all along the paper. It is interesting to 
note that the version of the 'droplet theory' [^3| which predicts the scaling C(t,t w ) ~ C(ln(i)/ \n(t w )) fails also 
in reproducing experiments and simulations, since the logarithmic law is too slow. 

Numerical results on 4D spin glasses also show that correlation functions are rather well represented by a 
t/t w -scaling in the aging regime |}4|, as is found in 3D. It would be extremely interesting to go back to the 4D 
simulations with asymmetrical couplings [po[ to study precisely the stationary regime, and see if, like in our 
simulation, there is a single time scale. It would be a disappointing result if all the richness of the ultrametric 
construction in spin glasses were a pure D — > oo feature. 

The situation is made even more puzzling by the fact that this construction and the associated separation 
of time scales are often invoked to explain the results of temperature cycling experiments ]qj36|. This is 
perhaps related to the difficulty in reproducing these experimental results with the 3D EA model with numerical 
simulations fl37tl. 
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